On the Gap between Automated and In-Vivo Evaluations of Web Accessibility

In this paper we present an accessibility analysis framework for the specification of Web accessibility evaluation scenarios that differentiates the requirements of users with disabilities, in order to achieve personalised accessibility assessment. We apply this framework to evaluations of Web Accessibility (e.g., WCAG 2.0 conformance) and to usability evaluations with users with disabilities. With this framework we leverage usability tests with these users in order to discern the non-automatable parts of WCAG and, consequently, skip the requirement of having experts analyse these parts for each personalisation scenario.